In: Bulletin of the World Health Organization: the international journal of public health = Bulletin de l'Organisation Mondiale de la Santé, Band 89, Heft 12, S. 907-912
BACKGROUND: The planning, resourcing, implementation and monitoring of new programmes by district health managers is integral for success and sustainability. Ethiopia introduced the Community-Based Newborn Care programme in 2014 to improve newborn survival: an innovative component allowed community health workers to provide antibiotics for young infants with possible serious bacterial infection when referral was not possible. Informed by the World Health Organization health system building block framework, we aimed to study the capacity and operational challenges of introducing this new health service from the perspective of programme implementers and managers at the district level 20 months after programme initiation. METHODS: This qualitative study was part of a programme evaluation. From November to December of 2015, we conducted 28 semi-structured interviews with staff at district health offices, health centres and implementing Non-Governmental Organisations in 15 districts of four regions of Ethiopia. Verbatim transcripts were analysed using a priori and emerging themes. RESULTS: In line with the government's commitment to treat sick newborns close to their homes, participants reported that community health workers had been successfully trained to provide injectable antibiotics. However, the Community-Based Newborn Care programme was scaled up without allowing the health system to adapt to programme needs. There were inadequate processes and standards to ensure consistent availability of (1) trained staff for technical supervision, (2) antibiotics and (3) monitoring data specific to the programme. Furthermore, Non-Governmental Organizations played a central implementing role, which had implications for the long-term district level ownership and thus for the sustainability of the programme. CONCLUSION: In settings where sustainable local implementation depends on district-level health teams, new programmes should assess health system preparedness to absorb the service, and plan accordingly. Our findings can ...
BACKGROUND: The planning, resourcing, implementation and monitoring of new programmes by district health managers is integral for success and sustainability. Ethiopia introduced the Community-Based Newborn Care programme in 2014 to improve newborn survival: an innovative component allowed community health workers to provide antibiotics for young infants with possible serious bacterial infection when referral was not possible. Informed by the World Health Organization health system building block framework, we aimed to study the capacity and operational challenges of introducing this new health service from the perspective of programme implementers and managers at the district level 20 months after programme initiation. METHODS: This qualitative study was part of a programme evaluation. From November to December of 2015, we conducted 28 semi-structured interviews with staff at district health offices, health centres and implementing Non-Governmental Organisations in 15 districts of four regions of Ethiopia. Verbatim transcripts were analysed using a priori and emerging themes. RESULTS: In line with the government's commitment to treat sick newborns close to their homes, participants reported that community health workers had been successfully trained to provide injectable antibiotics. However, the Community-Based Newborn Care programme was scaled up without allowing the health system to adapt to programme needs. There were inadequate processes and standards to ensure consistent availability of (1) trained staff for technical supervision, (2) antibiotics and (3) monitoring data specific to the programme. Furthermore, Non-Governmental Organizations played a central implementing role, which had implications for the long-term district level ownership and thus for the sustainability of the programme. CONCLUSION: In settings where sustainable local implementation depends on district-level health teams, new programmes should assess health system preparedness to absorb the service, and plan accordingly. Our findings can ...
BACKGROUND: In an era of increasingly competitive funding, governments and donors will be looking for creative ways to extend and maximise resources. One such means can include building upon professional advice networks to more efficiently introduce, scale up, or change programmes and healthcare provider practices. This cross-sectional, mixed-methods, observational study compared professional advice networks of healthcare workers in eight primary healthcare units across four regions of Ethiopia. Primary healthcare units include a health centre and typically five satellite health posts. METHODS: One hundred sixty staff at eight primary healthcare units were interviewed using a structured tool. Quantitative data captured the frequency of healthcare worker advice seeking and giving on providing antenatal, childbirth, postnatal and newborn care. Network and actor-level metrics were calculated including density (ratio of ties between actors to all possible ties), centrality (number of ties incident to an actor), distance (average number of steps between actors) and size (number of actors within the network). Following quantitative network analyses, 20 qualitative interviews were conducted with network study participants from four primary healthcare units. Qualitative interviews aimed to interpret and explain network properties observed. Data were entered, analysed or visualised using Excel 6.0, UCINET 6.0, Netdraw, Adobe InDesign and MaxQDA10 software packages. RESULTS: The following average network level metrics were observed: density .26 (SD.11), degree centrality .45 (SD.08), distance 1.94 (SD.26), number of ties 95.63 (SD 35.46), size of network 20.25 (SD 3.65). Advice networks for antenatal or maternity care were more utilised than advice networks for post-natal or newborn care. Advice networks were typically limited to primary healthcare unit staff, but not necessarily to supervisors. In seeking advice, a colleague's level of training and knowledge were valued over experience. Advice exchange primarily took place in person or over the phone rather than over email or online fora. There were few barriers to seeking advice. CONCLUSION: Informal, inter-and intra-cadre advice networks existed. Fellow primary healthcare unit staff were preferred, particularly midwives, but networks were not limited to the primary healthcare unit. Additional research is needed to associate network properties with outcomes and pilot network interventions with central actors.
In: Bulletin of the World Health Organization: the international journal of public health = Bulletin de l'Organisation Mondiale de la Santé, Band 95, Heft 6, S. 453-464C
Low-resource settings often have limited use of local data for health system planning and decision-making. To promote local data use for decision-making and priority setting, we propose an adapted framework: a data-informed platform for health (DIPH) aimed at guiding coordination, bringing together key data from the public and private sectors on inputs and processes. In working to transform this framework from a concept to a health systems initiative, we undertook a series of implementation research activities including background assessment, testing and scaling up of the intervention. This first paper of four reports the feasibility of the approach in a district health systems context in five districts of India, Nigeria and Ethiopia. We selected five districts using predefined criteria and in collaboration with governments. After scoping visits, an in-depth field visit included interviews with key health stakeholders, focus group discussions with service-delivery staff and record review. For analysis, we used five dimensions of feasibility research based on the TELOS framework: technology and systems, economic, legal and political, operational and scheduling feasibility. We found no standardized process for data-based district level decision-making, and substantial obstacles in all three countries. Compared with study areas in Ethiopia and Nigeria, the health system in Uttar Pradesh is relatively amenable to the DIPH, having relative strengths in infrastructure, technological and technical expertise, and financial resources, as well as a district-level stakeholder forum. However, a key challenge is the absence of an effective legal framework for engagement with India's extensive private health sector. While priority-setting may depend on factors beyond better use of local data, we conclude that a formative phase of intervention development and pilot-testing is warranted as a next step.
Effective utilisation of collaborative non-governmental organisation (NGO)-public health system linkages in pluralistic health systems of developing countries can substantially improve equity and quality of services. This study explores level and types of linkages between public health sector and NGOs in Uttar Pradesh (UP), an underprivileged state of India, using a social science model for the first time. It also identifies gaps and challenges for effective linkage. Two NGOs were selected as case studies. Data collection included semi-structured in-depth interviews with senior staff and review of records and reporting formats. Formal linkages of NGOs with the public health system related to registration, participation in district level meetings, workforce linkages and sharing information on government-supported programmes. Challenges included limited data sharing, participation in planning and limited monitoring of regulatory compliances. Linkage between public health system and NGOs in UP was moderate, marked by frequent interaction and some reciprocity in information and resource flows, but weak participation in policy and planning. The type of linkage could be described as 'complementarity', entailing information and resource sharing but not joint action. Stronger linkage is required for sustained and systematic collaboration, with joint planning, implementation and evaluation.
BACKGROUND: Since the global economic crisis, a harsher economic climate and global commitments to address the problems of global health and poverty have led to increased donor interest to fund effective health innovations that offer value for money. Simultaneously, further aid effectiveness is being sought through encouraging governments in low- and middle-income countries (LMICs) to strengthen their capacity to be self-supporting, rather than donor reliant. In practice, this often means donors fund pilot innovations for three to five years to demonstrate effectiveness and then advocate to the national government to adopt them for scale-up within country-wide health systems. We aim to connect the literature on scaling-up health innovations in LMICs with six key principles of aid effectiveness: country ownership; alignment; harmonisation; transparency and accountability; predictability; and civil society engagement and participation, based on our analysis of interviewees' accounts of scale-up in such settings. METHODS: We analysed 150 semi-structured qualitative interviews, to explore the factors catalysing and inhibiting the scale-up of maternal and newborn health (MNH) innovations in Ethiopia, northeast Nigeria and the State of Uttar Pradesh, India and identified links with the aid effectiveness principles. Our interviewees were purposively selected for their knowledge of scale-up in these settings, and represented a range of constituencies. We conducted a systematic analysis of the expanded field notes, using a framework approach to code a priori themes and identify emerging themes in NVivo 10. RESULTS: Our analysis revealed that actions by donors, implementers and recipient governments to promote the scale-up of innovations strongly reflected many of the aid effectiveness principles embraced by well-known international agreements - including the Paris Declaration of Aid Effectiveness. Our findings show variations in the extent to which these six principles have been adopted in what are three diverse geographical settings, raising important implications for scaling health innovations in low- and middle-income countries. CONCLUSION: Our findings suggest that if donors, implementers and recipient governments were better able to put these principles into practice, the prospects for scaling externally funded health innovations as part of country health policies and programmes would be enhanced.
In: Bulletin of the World Health Organization: the international journal of public health = Bulletin de l'Organisation Mondiale de la Santé, Band 90, Heft 9, S. 672-684
BACKGROUND: The Indian government supports both public- and private-sector provision of hospital care for neonates: neonatal intensive care is offered in public facilities alongside a rising number of private-for-profit providers. However, there are few published reports about mortality levels and care practices in these facilities. We aimed to assess care practices, causes of admission, and outcomes from neonatal intensive care units (NICUs) in public secondary and private tertiary hospitals and both public and private medical colleges enrolled in a quality improvement collaborative in Telangana and Andhra Pradesh-2 Indian states with a respective population of 35 and 50 million. METHODS AND FINDINGS: We conducted a cross-sectional study between 30 May and 26 August 2016 as part of a baseline evaluation in 52 consenting hospitals (26 public secondary hospitals, 5 public medical colleges, 15 private tertiary hospitals, and 6 private medical colleges) offering neonatal intensive care. We assessed the availability of staff and services, adherence to evidence-based practices at admission, and case fatality after admission to the NICU using a range of tools, including facility assessment, observations of admission, and abstraction of registers and telephone interviews after discharge. Our analysis is adjusted for clustering and weighted for caseload at the hospital level and presents findings stratified by type and ownership of hospitals. In total, the NICUs included just over 3,000 admissions per month. Staffing and infrastructure provision were largely according to government guidelines, except that only a mean of 1 but not the recommended 4 paediatricians were working in public secondary NICUs per 10 beds. On admission, all neonates admitted to private hospitals had auscultation (100%, 19 of 19 observations) but only 42% (95% confidence interval [CI] 25%-62%, p-value for difference is 0.361) in public secondary hospitals. The most common single cause of admission was preterm birth (25%) followed by jaundice (23%). Case-fatality rates at age 28 days after admission to a NICU were 4% (95% CI 2%-8%), 15% (9%-24%), 4% (2%-8%) and 2% (1%-5%) (Chi-squared p = 0.001) in public secondary hospitals, public medical colleges, private tertiary hospitals, and private medical colleges, respectively, according to facility registers. Case fatality according to postdischarge telephone interviews found rates of 12% (95% CI 7%-18%) for public secondary hospitals. Roughly 6% of admitted neonates were referred to another facility. Outcome data were missing for 27% and 8% of admissions to private tertiary hospitals and private medical colleges. Our study faced the limitation of missing data due to incomplete documentation. Further generalizability was limited due to the small sample size among private facilities. CONCLUSIONS: Our findings suggest differences in quality of neonatal intensive care and 28-day survival between the different types of hospitals, although comparison of outcomes is complicated by differences in the case mix and referral practices between hospitals. Uniform reporting of outcomes and risk factors across the private and public sectors is required to assess the benefits for the population of mixed-care provision.
Background: Understanding the context of a health programme is important in interpreting evaluation findings and in considering the external validity for other settings. Public health researchers can be imprecise and inconsistent in their usage of the word "context" and its application to their work. This paper presents an approach to defining context, to capturing relevant contextual information and to using such information to help interpret findings from the perspective of a research group evaluating the effect of diverse innovations on coverage of evidence-based, life-saving interventions for maternal and newborn health in Ethiopia, Nigeria, and India. Methods: We define "context" as the background environment or setting of any program, and "contextual factors" as those elements of context that could affect implementation of a programme. Through a structured, consultative process, contextual factors were identified while trying to strike a balance between comprehensiveness and feasibility. Thematic areas included demographics and socio-economics, epidemiological profile, health systems and service uptake, infrastructure, education, environment, politics, policy and governance. We outline an approach for capturing and using contextual factors while maximizing use of existing data. Methods include desk reviews, secondary data extraction and key informant interviews. Outputs include databases of contextual factors and summaries of existing maternal and newborn health policies and their implementation. Use of contextual data will be qualitative in nature and may assist in interpreting findings in both quantitative and qualitative aspects of programme evaluation. Discussion: Applying this approach was more resource intensive than expected, in part because routinely available information was not consistently available across settings and more primary data collection was required than anticipated. Data was used only minimally, partly due to a lack of evaluation results that needed further explanation, but also because contextual data was not available for the precise units of analysis or time periods of interest. We would advise others to consider integrating contextual factors within other data collection activities, and to conduct regular reviews of maternal and newborn health policies. This approach and the learnings from its application could help inform the development of guidelines for the collection and use of contextual factors in public health evaluation.
OBJECTIVES: Primary objective: to assess nine data quality metrics for 14 maternal and newborn health data elements, following implementation of an integrated, district-focused data quality intervention. SECONDARY OBJECTIVE: to consider whether assessing the data quality metrics beyond completeness and accuracy of facility reporting offered new insight into reviewing routine data quality. DESIGN: Before-and-after study design. SETTING: Primary health facilities in Gombe State, Northeastern Nigeria. PARTICIPANTS: Monitoring and evaluation officers and maternal, newborn and child health coordinators for state-level and all 11 local government areas (district-equivalent) overseeing 492 primary care facilities offering maternal and newborn care services. INTERVENTION: Between April 2017 and December 2018, we implemented an integrated data quality intervention which included: introduction of job aids and regular self-assessment of data quality, peer-review and feedback, learning workshops, work planning for improvement, and ongoing support through social media. OUTCOME MEASURES: 9 metrics for the data quality dimensions of completeness and timeliness, internal consistency of reported data, and external consistency. RESULTS: The data quality intervention was associated with improvements in seven of nine data quality metrics assessed including availability and timeliness of reporting, completeness of data elements, accuracy of facility reporting, consistency between related data elements, and frequency of outliers reported. Improvement differed by data element type, with content of care and commodity-related data improving more than contact-related data. Increases in the consistency between related data elements demonstrated improved internal consistency within and across facility documentation. CONCLUSIONS: An integrated district-focused data quality intervention-including regular self-assessment of data quality, peer-review and feedback, learning workshops, work planning for improvement, and ongoing support through social media-can increase the completeness, accuracy and internal consistency of facility-based routine data.
BACKGROUND: The collaborative quality improvement approach proposed by the Institute for Healthcare Improvement has the potential to improve coverage of evidence-based maternal and newborn health practices. The Safe Care, Saving Lives initiative supported the implementation of 20 evidence-based maternal and newborn care practices, targeting labour wards and neonatal care units in 85 public and private hospitals in Telangana and Andhra Pradesh, India. OBJECTIVE: We present a protocol for the evaluation of this programme which aims to (a) estimate the effect of the initiative on evidence-based care practices and mortality; (b) evaluate the mechanisms leading to changes in adherence to evidence-based practices, and their relationship with contextual factors; (c) explore the feasibility of scaling-up the approach. METHODS: The mixed-method evaluation is based on a plausibility design nested within a phased implementation. The 29 non-randomly selected hospitals comprising wave II of the programme were compared to the 31 remaining hospitals where the quality improvement approach started later. We assessed mortality and adherence to evidence-based practices at baseline and endline using abstraction of registers, checklists, observations and interviews in intervention and comparison hospitals. We also explored the mechanisms and drivers of change in adherence to evidence-based practices. Qualitative methods investigated the mechanisms of change in purposefully selected case study hospitals. A readiness assessment complemented the analysis of what works and why. We used a difference-in-difference approach to estimate the effects of the intervention on mortality and coverage. Thematic analysis was used for the qualitative data. DISCUSSION: This is the first quality improvement collaborative targeting neonatal health in secondary and tertiary hospitals in a middle-income country linked to a government health insurance scheme. Our process evaluation is theory driven and will refine hypotheses about how this quality improvement approach contributes to institutionalization of evidence-based practices.